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Abstract. The main result of this article is sub-additivity of the dp-rank. 
We also show that the study of theories of finite dp-rank can not be reduced 
to the study of its dp-minimal types, and discuss the possible relations between 
dp-rank and VC-density. 



1. INTRODUCTION 

This paper grew out of discussions that the authors had during a meeting in 
Oberwolfach in January 2010, foUowing a talk of Deirdre HaskeU, and conversations 
with Sergei Starchenko, on their recent joint work with Aschenbrenner, Dohch and 
Macpherson [5]. Haskell's talk made it apparent to us that the notion of VC-density 
( Vapnik-Chervonenkis density) , investigated in [5] , is closely related to "dependence 
rank" (dp-rank) introduced by the third author in [14]. Discussions with Starchenko 
helped us realize that certain questions, such as additivity, which were (and still 
are, to our knowledge) open for VC-density, may be approached more easily in the 
context of dp-rank. This paper is the first step in the program of investigating basic 
properties of dp-rank and its connections with VC-density. 

Whereas dp-rank is a relatively new notion, VC-density and related concepts 
have been studied for quite some time in the frameworks of machine learning, com- 
putational geometry, and other branches of theoretical computer science. Recent 
developments point to a connection between VC-density and dp-rank, strengthening 
the bridge between model theory and these subjects. We believe that investigating 
properties of dp-rank is important for discovering the nature of this connection. 
Furthermore, once this relation is better understood, theorems about dp-rank are 
likely to prove useful in the study of finite and infinite combinatorics related to 
VC-classes. 

Dp-rank was originally defined in [T3] as an attempt to capture how far a certain 
type (or a theory) is from having the independence property. It also helped us to 
isolate a minimality notion of dependence for types and theories (that is, having 
rank 1). We called this notion dp- minimality and investigated it in [7]. Both dp- 
rank and dp-minimality were simplifications of Shelah's various ranks from |12| . 
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and appropriate minimality notions. Our simplified notion of rank turned out to 
be very close to Slielali's Kict, but localized to a type. 

A few characterizations of dp-minimality have since been given in the litera- 
ture, and similar equivalences can also be applied to higher ranks. It seems clear 
at this point that part of the strength of this concept is the interaction between 
those equivalent definitions. We are mainly referring to the "standard" (syntactic) 
independent array definition as given in |14[ [8] (see Definition 12. 4p , which is very 
useful when one wants to deal with formulas, and a very simple "semantic" variant 
(see Definition 12. ip . which can be found, for the dp-minimal case, in Simon's paper 
(|13|). but which (as far as we know) has never been stated for a type with rank 
greater than 1. In this paper, we will mainly work with the semantic definition, 
which proves useful and convenient for our purposes. However, throughout the 
paper we prove quite a few different characterizations of dp-rank, especially in the 
finite rank case; we summarize them in Theorem 15.41 

As the word "rank" indicates, dp-rank is a certain measure of the "size" of a 
type. It would probably be more accurate to say that dp-rank measures "diversity" 
of realizations of the type - how much the realizations differ from each other, as 
can be seen by external parameters. We will elaborate on this below. Just as 
with most rank notions, one wonders whether it has basic properties such as sub- 
additivity: the rank of a tuple should be bounded by the sum of the ranks of its 
elements. This is the main result of Section SI As a corollary, we obtain global 
bounds for alternation ranks of formulas in a theory of finite rank (so in particular 
in a dp-minimal theory). 

Dp-rank is a notion which is related to weight in stable theories (and motivated 
by it), and to certain more recent notions of weight in dependent theories, e.g. [7], 
[8] , and [6] . It is therefore natural to wonder whether dp-rank can play a role similar 
to weight in dependent theories. Although this is still a line of work which can be 
pursued (and probably provides natural lines of research), in this paper we give 
limitations to the analogy, showing that dp-rank fails to have certain properties 
that one would hope for in a notion of weight, in at least two significant ways. 

One of our original intentions (influenced greatly by the weight analogy) was to 
prove results for dp-minimal types, and then try to extend them to higher ranks 
by induction, at least for the finite rank case. The analogy with weight in stable 
(and even simple) theories led us to ask whether every type of finite dp-rank can 
be "analyzed" to some extent by types of rank 1. This turns out to be not the case, 
and provides the first limitation to the weight comparison. Example 12.101 presents 
a theory with types of finite rank but no dp-minimal types. This is a very "tame" 
strongly dependent theory (hence of "finite weight" - in fact, of dp-rank 2), but 
there are no types of "weight" 1 (whatever definition of weight one chooses to use; 
see e.g. |7]). 

Another direction where the analogy fails is the finite/infinite correspondence. 
Hyttinen's results in [4], that yield a decomposition a type of finite weight in a stable 
theory into types of weight 1, also imply that no type has infinite but "rudimentarily 
finite" weight. In other words, if a type has weight Hg, then there exists an infinite 
set witnessing this. In Subsection 12.21 (particularly. Theorem I2.13P we observe 
that this fails to be the case for dp-rank, even in stable theories. The example 
presented there also answers negatively an analogous question concerning Adler's 
notion of burden in [1] (since burden is essentially the same as dp-rank in dependent 
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theorietlj). Specifically, this is an example of an Ho-stable theory (in particular, 
superstable) such that every type over has infinite dp-rank. Since in a superstable 
theory weight of any given complete type is finite. Theorem 12 . 131 exemplifies a very 
important difference between weight and dp-rank: weight only takes into account 
nonforking extensions of the type; so when passing to a forking extension, weight 
may grow. Dp-rank does not distinguish between different kinds of extensions, so 
it can only go down when the set of parameters is increased (as is the case with 
most rank/dimension notions). 

In a sense, with the notion of dp-rank, we capture a very particular aspect of 
the size of the type, and our thesis is that it might be "better" to think of dp-rank 
in relation to finite combinatorial invariants of Vapnik-Chervonenkis (VC) classes, 
particularly, VC-density, instead of in terms of weight. 

VC-density is one of the possible measures of growth rate of types over finite sets. 
Specifically, assuming that A(x,y) is a finite set of dependent formulas (which is 
equivalent to the growth rate of the number of finite A-types being polynomial 
rather than exponential), VC-density bounds the degree of the corresponding poly- 
nomial. So VC-density 1 corresponds to linear growth of the number of A-types 
over finite sets. We prove in Section [5] that one way of looking at dp-rank is the fol- 
lowing: dp-rank of a type p corresponds to the degree of a polynomial that measures 
how many types can a realization c \^ p realize over finite indiscernible sequences. 
In other words, dp-rank of p is a measure of the number of realizations of p that 
have different types over finite indiscernible sequences. 

So in particular dp-minimality means that realizations of p realize only order of 
n types over any given indiscernible sequence of length n. This is equivalent, as 
is shown in Section [21 to the following: subsets of indiscernible sequences that a 
realization of p can definably pick are simply intervals. These intervals can be, of 
course, of length 1 (that is, singletons). The important observation here is that 
a dp-minimal element can not pick (definably) a finite tuple of size bigger than 1 
from an arbitrary indiscernible sequence. Or, more precisely, its alternation rank 
can not be bigger than 2. In this respect the behavior of a dp- minimal element 
resembles an element in either an o-minimal theory, or the theory of equality. 

A number of distinctions between the notions of VC-density and dp-rank should 
be pointed out. The obvious ones are that we only count number of types over 
indiscernible sequences (as opposed to arbitrary finite sets), and restrict ourselves 
to realizations of a given type (the second one is not important - one can look 
at dp-rank of a partial type as well). Another difference is that, when calculating 
dp-rank, we do not restrict the set of formulas that one is allowed to use to a finite 
set. This is why, even in a strongly dependent theory, one can end up with types 
of dp-rank uj (one obtains more and more types over indiscernible sequences by 
changing the formulas), one more thing that Theorem 12. 131 exemplifies. 

However, dp-rank is a very natural model theoretic analogue of VC-density. 
Part of the strength of model theoretic techniques is the ability to approximate 
complex phenomena in better behaved structures. Indiscernible sequences have 
already proved very helpful for such approximations in various contexts. Seeking 
connections between VC-density and dp-rank is another implementation of this 
idea. 



If either is finite then the two coincide; for infinite cardinals the dp-rank of a type may be the 
successor of the burden of the type. 
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Since we work with the semantic definition of dp-rank, we need some technical 
results on indiscernible sequences which are quite interesting on their own. In 
Section [3] we prove a proposition (Proposition 13. 3p which provides a "consistent" 
way to extend indiscernible sequences in an arbitrary theory. Specifically, in the 
proofs in Section |4] we are sometimes faced with the following situation: a sequence 
/ is indiscernible over various subsets of a set B, but not (necessarily) over B, and 
we would like a uniform way of extending / to a longer sequence with the same 
properties. If the theory is assumed to be dependent (and / is unbounded) one can 
just take the average type of / over B. However, we are not assuming dependence, 
and it seems of independent interest to find a general technique allowing this (and 
more) in an arbitrary theory. Here Shelah's general notion of average type with 
respect to an ultrafilter conies in handy. 

1.1. Structure of the paper. We begin Section [2] with definitions, characteriza- 
tions, and basic properties. Then we proceed to a few examples, which point out 
what one can and can not expect from dp-rank. 

In Section [3] we develop a consistent way of extending mutually indiscernible 
sequences, which serves us in Section S) 

In Section |4] we will prove the main result of the paper, the sub-additivity of the 
dp-rank. We start with the dp-minimal case, then proceed to types of finite rank, 
and finally the infinite case. There was no need, in fact, to give a separate proof for 
dp-minimal types: the general finite case can be easily modified to include rank 1 as 
well. However, the proof for dp-minimal types is much less involved, so we include 
it in order to exemplify the general principles that are used, and then proceed to 
the finite case by induction. The proof for infinite ranks is different, but easier - 
infinite combinatorics is more flexible, and calls for much less precise computations. 
We conclude the section with some corollaries, such as global bounds on alternation 
ranks of formulas. 

In Section [5] we discuss what is known about the relation between VC-density 
and dp-rank. Theorem 15.41 summarizes all the main equivalent ways of looking at 
dp-rank. We also pose a few questions and set up a framework for future work. 

Throughout the paper, we will work in a monster model of an arbitrary first 
order theory T. In particular, although the main object of study is a "dependence 
rank", at no point do we assume that T is dependent. 

We will not distinguish between singletons and finite tuples in the notation. For 
example, when writing (p{x), or "a is in the sort of x", if not specified otherwise, x 
and a could be tuples. 

2. Dp-rank: definitions and basic properties 
We begin with the definition of the main notion investigated in this paper. 

Definition 2.1. Let p{x) be a partial (consistent) type over a set A. We define 
the dp-rank of p{x) as follows. 

• The dp-rank of p{x) is always greater or equal than 0. Let /i be a cardinal. 
We will say that p{x) has dp-rank < p (which we write rk-dp(p) < fi) 
if given any realization a of p and any 1 + n mutually A-indiscernible 
sequences, at least one of them is indiscernible over Aa. 
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• We say that p has dp-rank fj. (or rk-dp(p) ~ /.j) if it has dp-rank < /x, but 
it is not the case that it has dp-rank < A for any X < fj,. 

• We call p dp-minimal if it has dp-rank 1. 

• We call p dependent if dp-rank of p exists, that is, if it is an ordinal. In 
this case we write rk-dp(p) < oo. Otherwise we write rk-dp(p) = oo. 

• We call p strongly dependent if rk-dp(p) < uj. 

Remark 2.2. It may seem that dp-rank of p depends on the set A; however, we 
will see in Remark 12.71 below that this is not the case. Hence all the notions in 
Definition 12.11 above are well defined. 

The following is easy and standard. 

Remark 2.3. The following hold for any (partial) type p{x) and a set A. 

(i) p has dp-rank if and only if it is algebraic. 

(ii) p is dependent if and only if the rk-dp(p) < 

(iii) If p is a type over a set A, and p' is a type over a set B D A that extends 
p, then rk-dp(p') < rk-dp(p). 

In particular, if p is dp-minimal, then any extension of it is either dp-minimal or 
algebraic. 

Definition 12.11 is a nice semantic characterization of the notion of dp-rank. We 
find it more convenient for the purposes of this paper than the syntactic definition 
in [5]. It is also much easier to grasp, in case one is unfamiliar with the concept. 
However, when working with formulas, it is useful to have a more syntactic notion, 
and we would like to prove that our "soft" characterization is equivalent to the 
original one. In case the reader is unwilling to deal with technical concepts, it is 
possible to skip the following definition and Proposition 12.61 in the first reading. 
These will not be used almost at all in the main body of the paper (Sections [3] and 
|4]), but they are key for understanding important characterizations of dp-rank in 
the finite case and the connection to VC-density (Proposition 12.81 and Section [S|) , 
as well as the fact that dp-rank of a type does not depend on the set over which it 
is calculated. 

The following definitions were motivated by the original definition of strong 
dependence by Shelah (see e.g. [T2]) and appear in [T3] and [7]. 

Definition 2.4. A randomness pattern of depth k for a (partial) type p{x) over 
a set A is an array {bf : i < ijj)a<K and formulae ^Pa{x^ ya) for a < k such that: 

(i) the sequences /" = {bf)i^^ are mutually indiscernible over A\ that is, /" 
is indiscernible over 

(ii) length{bf) = length{ya), 

(iii) for every rj G '^uj, the set 

r,, = {Lpa{x,bf^)}a<n U {^fa{x,bf)}a<K,^<UJ,i^r,{a) 

is consistent with p. 
We will omit A if it is clear from the context. 

The following is standard. 

Lemma 2.5. Let p be a (partial) type over a set A. Then there is a randomness 
pattern of depth k over A if and only if there exists an array (bf: i < uj)a<K o,nd 
formulae ipa{x,ya) for a < k that satisfy clauses (ii) and (iii) of Definition \2.4\ 
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Proof. Without loss of generality A = (note that A contains the domain of p). 
Given an array satisfying clauses (ii) and (iii) of Definition 12.41 we may assume by 
compactness that the all the k sequences (bf) are as long as we wish, {bf : i < X) 
for A arbitrarily big. Applying Ramsey's Theorem and compactness, one obtains 
new sequences for which clause (i) of the definition of a randomness pattern holds 
as well. □ 



One consequence of the Lemma is the following: let p be a type, and let A, B 
be sets, both containing the domain of p. Then there is a randomness pattern of 
depth K for p over A if and only if there exists such a pattern over B. 

In j8] we defined dp-rank of a type p{x) as the supremum of all k, such that there 
is a randomness pattern of depth k for p{x). The following Proposition shows that 
Definitions 12 . f I above are equivalent to the original ones. 

The first appearance of any such equivalence appeared for the dp-minimal case 
in Lemma 1.4 of [13]. We do not know that anyone has generalized this even for 
finite dp-ranks (or randomness patterns of finite depth) . 

Proposition 2.6. The following are equivalent for a complete type p{x) over A. 
Notice that k below may be a finite cardinal. 

(i) There is a randomness pattern of depth k for p[x) over A. 

(ii) R is not the case that the dp-rank of p{x) is less than or equal to k. 

(iii) There exists a set T :~ {P} :~ {(a^)ig/ \ j & k} of k infinite mutually 
indiscernible sequences over A, and a realization c of p{x) such that for all 
j there are ii,i2 such that tp(a^^/y4c) ^ tp(a^^/j4c). 

Proof. The proof of the equivalence of (ii) and (iii) in [13] works exactly for the 
general case. Also, it is clear that (i) implies (iii). 

Assume (iii) and we will prove (i). Let Ij :~ (a^) and we will assume that 
all such P are indexed by Z, and let tp^ be the formula such that tp^ (c, ) and 
-^ip^ (c, Oi^) holds. 

Claim 2.6.1. If {i \ (p^(c, a^)} is both coinitial and cofinal, then there is a subse- 
quence /q of P such that (after re-enumerating the elements) /q :— (a"'-')igz and 
-"y9-' (c, a^'-') holds if and only if i = 0. 

Proof. The construction of /q is immediate from the definition. □ 

Notice that if in every sequence we have that either {i \ </j-' (c, a^)} or {i \ 
-i(p^{c,a\)} is coinitial and cofinal, then we can replace P by the subsequence /q 
and (replacing f^{x, y) for ^ip^ {x, y) if necessary) we would have an instance of (i). 

Now, if for some j we have that both {i \ tp^(c,al)} and {i \ -itp^ {c, a^)} are not 
coinitial and not cofinal, then we have that, for example, {i \ ip^ (c, a-'^)} is coinitial 
and {i \ -np^ (c, a\)} is cofinal. In this case, if we define p^ := cp^ (x, yi) A -^Lp^ (x, 2/2) 
and /q as a sequence (o2i' '^2i+i)'6Zi would preserve the mutual indiscernibility, 
we would have instances of both <y5o(''' '^2i' '^2i+i) ^'^'^ ~'¥'o('^i '^21' '^2i+i)i ^'^'^ {* I 
-Kp-' (c, Ojj, a2j_|_]^)} would be coinitial and cofinal. Applying the claim to all such 
sequences we would have an instance witnessing (i). □ 
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Remark 2.7. It follows from Lemma [2.51 and the equivalence of (i) and (ii) in 
Proposition 12.61 that dp-rank of a type does not depend on the set A over which it 
is computed. In other words, the notion rk-dp(p) in Definition 12. II is well-defined. 

In the finite rank case, we can prove another characterization of dp-rank, in 
terms of a natural generalization of the notion of alternation rank. Given a formula 
ip{x,y), we define the p-alternation rank of (y3(x, y) over ^ as follows: a\t^^^\ip{x , y)) > 
k if there exists an ^-indiscernible sequence / and c \= p such that the truth value 
of </j(c, y) has k alternations in /. The p-alternation rank of ip{x, y) over A is the 
maximal k (if exists) such that ali^^^\ip) > k. As usual, if p G S(A), we may omit 
A. 

Proposition 2.8. The following are equivalent for a partial type p{x) over A and 
k < ui: 

(i) rk-dp(p) > k. 

(ii) There exists a formula ip{x, y) and an A-indiscernible sequence I in the 
sort of y such that for every subset I' Q I of size k, there is a p such 
that ip{c,y) n / = /'. 

(iii) There exists a formula ip{x,y) such that alt^^\ip{x,y)) > 2k. 

All the indiscernible sequences in the Proposition are presumed to be infinite. 
Notice also that what (ii) is essentially saying is that every /c-tuple in / is (p{c,y)- 
definable for some c \= p. 

Proof, (i) =^ (ii). We will use the syntactic definition here. If rk-dp(p) > fc, then 
by Proposition 12.61 there is a randomness pattern of depth k for p{x); that is, there 
are c \== p, formulas ipi{x,yi), . . . , ipk{x, yu) and A-mutually indiscernible sequences 
Ii = (a* : j < io) in the sort of yi (for i = 1, . . . , fc), such that for every ji, . . . ,jk 
there is c = Cj-^_,,,jy. \= p such that ^Piic, a* ) if and only if j = ji. 

Let iy9(a;, yi . . .yk) = ViLi yi)i and let / be an A-indiscernible sequence in 
the sort of yi . . . y^ defined as follows: / = (oj : j < uj), where aj = aj . . . a^. 

Choose arbitrary k distinct indices ji, . . . , jfc. It is easy to see that c = Cj-^^,,,j^ 
is a realization of p such that ip{c, Oj) if and only if j G {ji, . . . ,jk}, as required in 

(ii). 

(ii) =^ (iii) is trivial. 

(iii) (i). Let / be an A-indiscernible sequence and c \= p such that ip(c,y) 
has > 2k alternations in /. We may assume that the number of alternation is finite, 
and in fact equal to 2k. We prove by induction on k the following claim: 

Claim. If / is an A-indiscernible sequence of order type Q, and (p(c, y) has 2k 
alternations in /, then there is a randomness pattern (/", if") of depth k for tp(c/A) 
with /" being segments of /, and ip"' ~ ip ot ip"' ~ -up for all a. 

The base case A; = is trivial. So now given / — {oq : q G Q) and c as in the 
claim, since the order type of / is Q, there is an infinite initial segment on which 
ip{c,y) is constant; assume for example that <p{c,y) holds, and let ?- e R be the 
minimal cut such that for any q > r, the truth value of (p{c, y) has changed signs 
twice in the interval (—00,17). Let q > r be such that (^(c, Og) holds, and there is 
no sign change between r and q. Let ~ {a<r)'~' {0'{r,q)) and Lp^ — ip. Notice that 
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by indiscernibility and compactness, given any G the type 

jG/"\{a,} 

is consistent. 

By the induction hypothesis, since the order type of />q = {o->q) is still Q, and 
since />g has at least 2k ~ 2 alternations of (p{c,y), we can find a randomness 
pattern {/"}, {(fi"} for c over A, for a = 1, . . . , fc — 1 and /" segments of />g. Now 
clearly {I°'}a=o '"^^^ mutually A-indiscernible (since they are all segments of the 
same ^-indiscernible sequence), and it is easy to see that {/"}Q<fc, {<i3"}a<fc is a 
randomness pattern for c over A of depth k. 

This finishes the proof of the claim, and the theorem. 

□ 

Corollary 2.9. Assume that in a theory T every type p{x) over in the sort of x 
has dp-rank < k. Then for every formula (f{x,y), the alternation rank of (f(x^y) is 
hounded by 2k + 1. 

Proof. If alt{(p{x,y)) > 2k + 2, then there is an indiscernible sequence in the sort 
of y and some c in the sort of x, that witness this. By (iii) =>{i) in Proposition [2?8l 
rk-dp(tp(c/0)) > fc + 1. □ 

We conclude this section with a a few examples that illustrate things which can 
not be expected from dp-rank. We will leave some of the technical details of the 
examples to the reader. 

2.1. Theory of dp- rank 2 with no dp-minimal types. As we mentioned above, 
one might be drawn to think that all the study of theories of finite dp-rank (theories 
where all dp-ranks are finite) can be reduced to dp-minimal types. This, however 
is not the case. 

Example 2.10. Consider the theory of an infinite set with two dense linear orders 
<i and <2, and take the model completion of it. This is, the theory of a structure 
M in C {<i,<2} such that any finite formula consistent with <i and <2 being 
dense linear orders is realized in M. 

Every one type has dp-rank 2, and there are no dp-rank 1 types: 
First of all, the model completion exists and by definition it is complete and 
has elimination of quantifiers in the language C := {<i,<2}, so tp{a/A) can be 
understood by formulas of the form x <i a, x <2 a, and x — a for suitable choices 
of a e A. 

It is not hard to show now that given any set A, any 1-variable type p{x) £ S{A) 
has dp-rank 2. Given any such set and type, it is enough to find mutually A- 
indiscernible sequences (a^) and (bj) such that for every k,£ we have: 

• The set 

p{x) U {x >i ai}i<k U {x <i ai}iyk U {x >2 bj}j<i U {x <2 &j}i>f 
is consistent. 

For this, it is enough to find for every m < uj, sequences (a,) and (bj) for i, j < m 
such that for every k,i < m we have: 
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• The set 

p{x) U {x >i ai}i<k. U {x <i a,;}i>fc U {x >2 bi}i<i U {x <2 bjjj^i 
is consistent. 

Such tti and bj can be found by the definition of a model companion. 

This imphes that every type in this theory has dp-rank at least 2, and in partic- 
ular that there are no dp-minimal types. On the other hand, it is easy to see that 
no one-type (over any set) has dp-rank bigger than 2. 

2.2. Type of dp-rank a; in a theory with types of finite weight. People have 
asked whether or not strong dependence was equivalent to every type having finite 
dp-rank, in the same way that a stable theory is strongly dependent if and only if 
every type has finite weight (some people asked this for Adler's notion of burden 
[1], which is essentially the same question). Specifically, the question is whether or 
not it is possible to have randomness patterns of arbitrarily large finite depths but 
no randomness pattern of infinite depth for a given complete type p{x) (once one 
forgets the type and just asks whether there is a strongly dependent theory with 
arbitrarily deep randomness patterns, the question becomes much easier). 

The following provides an example that the above is possible even in stable 
theories. 

Let 

S := {(to, n) e N X N I to < n} 

and let <s (which we sometimes denote simply by < for simplicity) be the partial 
order on S defined by (mi,ni) <s {m2,n2) if and only if ni < ri2. 

If s = (m, n), we say that s is of level n, and write lev(s) = n. Note that s < t 
if and only if s is of a smaller level than t (or s = t). So s ^ t are incomparable if 
and only if they are of the same level. Hence there are finitely many fs which are 
incomparable to a given s - in fact, the number is exactly the lcv(s). 

So we have: 

Observation 2.11. The following hold for {S, <s)- 

(i) For any s E S there are finitely many s' £ S which are not greater than s. 

(ii) For any n G N there exists si, . . . , s„ £ S such that Si is incomparable to 
Sj for all 1 < i ^ j < n. 

Now consider the theory Ty in the language C := {i^^jsgg which states that all 
Es are equivalence relations and for any s <s t we have 

yx,y, xE^y xEty. 

Let T be the model completion of Ty, so in particular it is a complete theory 
with elimination of quantifiers. 

T is axiomatized by the following axioms. In order to make things more uniform, 
let us refer to equality as the unique s of level -1. 

• Every class of every Eg for s G 5* is infinite. 

• Every Eg has infinitely many classes. 

• Whenever — 1 < n < to, lev(s) = n, lcv(ii) = lcv(i2) = . . . = lcv(tfe) = to, 
Ai is an equivalence class of Et^ (for i = 1, . . . , fc), then n^Lj^Ai contains 
infinitely many classes of Eg. 
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Even without proving the existence of the model completion, one can show di- 
rectly, given the above axioms and using a standard back and forth argument, that 
T is a complete theory with elimination of quantifiers. 

Claim 2.12. T is '^Q-stable. 

Proof. For every (non-generic) type p over a countable model M, let lev(p) be the 
least n, such that there exists a € M and s of level n, such that the formula xEgU 
is in p. Since this determines which Et classes p "chooses" for s < t, there are 
only finitely many equivalence relations left to "settle" - specifically, all those Et 
for which s ^ t (see Observation 12.111 above) . It follows (by quantifier elimination) 
that there are countably many types of each given level n. Since there are countably 
many levels, we are done. □ 

We can now show that T is an example of a theory with non finite dp-rank and 
no randomness pattern of depth io for the unique type p{x) over the empty set. 

Theorem 2.13. For any element c and any natural number n, one can find I 
such that I is a set of n mutually indiscernible sequences (over %) none of which is 
indiscernible over c. However, no such example can be found with I infinite. 

Proof. Let n be a natural number, and let si, . . . , s„ be incomparable elements of 
S of level n (see Observation 12. lip . By the axioms of T we can find /i , . . . , /„ 
mutually indiscernible sequences of singletons with the following properties: 

• Elements of h are iJ^j -equivalent if and only if j ^ i, 

• c is E's; -equivalent to the first element of li for all i. 

Clearly, none of the /^'s is indiscernible over c, as required. 

On the other hand, by Claim 12.121 T is superstable, hence strongly dependent 
(this is very easy to see directly, but see |12|). So there is no infinite randomness 
pattern for any type in any model of T. (Alternatively, using quantifier elimination, 
one can easily give a direct proof that there is no infinite randomness pattern.) □ 

Remark 2.14. In a similar fashion, one constructs an example of a theory which 
is not superstable, but still strongly dependent, with a type of dp-rank lj. This is 
done by switching the "nesting order" of the equivalence relation in the example 
above; that is, we demand in the universal theory that for s <g t we have 

Va;,y, xEty xEsy. 

Here one has to give a direct argument as to why there is no infinite randomness 
pattern; but this quite straightforward, using quantifier elimination, and we leave 
it to the reader. 

Recall that in a strongly stable theory (strongly dependent and stable) every 
type has finite weight ([TJ [H]). However, in both examples discussed above, the 
unique (non- algebraic) type over has dp-rank uj. So we have two examples of 
theories where every type has finite weight but there are no non algebraic types of 
finite dp-rank over 0. In fact, the generic type over any set will also have dp-rank 
w by a similar argument. In the example discussed in Remark 12.141 the situation 
is even more extreme, because almost all types have infinite dp-rank (besides the 
algebraic and the strongly minimal ones). 
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3. Extending indiscernible sequences 

Since the main definition of the paper involves mutuahy indiscernible sequences, 
it would be nice to have certain tools for handling such "independent arrays". Specif- 
ically, we would like to have a "consistent" way of extending indiscernible sequences. 
Our technique will make use of Shelah's notion of average types with respect to ul- 
trafilters, which provides a way of constructing co-heir extensions. In spite of its 
usefulness, this notion does not yet seem to be widespread in the model theoretic 
community. 

First, we recall the following easy observation. 

Fact 3.1. Given a set A and an infinite indiscernible sequence I = (a.j : i G /) over 
A, there exists a unique complete type p over AI such that if a \= p, then (a) is 
indiscernible over A. 

This fact provides a natural and standard way to extend indiscernible sequences. 
However, it will not always be good enough for us, since, as mentioned in the intro- 
duction, we will need to extend sequences preserving indiscernibility over different 
subsets. 

This is why the definition of average types from Shelah becomes useful: 

Definition 3.2. Let / ~ (a^) be an indiscernible sequence and 14 an ultrafilter on 
the index set of /. Given any set B we will define Avgu{I , B), the average type of 
I over B given by U, as the unique complete type p{x) such that for every formula 
^p{x^ y) and b £ B we have 

(p{x, b) G p{x) {i I (p{x, a,;)} G U. 

This definition will allow us to prove the following. The proof requires some 
knowledge of ultrafilters. 

Proposition 3.3. Let I be an indiscernible sequence indexed by an order with 
no last element, and let B be any set. Then, for any indexing set X, there is 
an indiscernible sequence I* indexed by X such that I'~ I* is indiscernible over A 
whenever A C_ B is a set such that I was already indiscernible over A. 

Proof. We will prove the result for any finite /*. The general case follows by 
compactness. 

If we take 14 to be an ultrafilter over / such that every set in U is unbounded in /, 
it follows from the definition that for any A such that / is indiscernible over A and 
any oq |= Avgu^I, AI) we have /'^(a) is indiscernible over A. Since the definitions 
imply that Avgu{I , BI) extends Avgu(I , AI) for any such A C B, any realization 
ao of the type p{x) :— Avgu(I , BI) will be such that /'~~(ao) is indiscernible over 
A. Inductively, it follows from the properties of average types that if we let 

fln+i h Avgu{I, BI'~ {On, a„„i, . . . , Oq)) 

then I'~' {on+i, On, On-i, • • • , flo) is an indiscernible sequence over A. This construc- 
tion will therefore give us an indsicernible sequence /', indexed by n, such that 
is indiscernible over any A over which / was indiscernible (for an arbitrarily large 
n); by compactness, given any indexing set A, we can find an indiscernible sequence 
I* indexed by A such that I'~^I* satisfies the conclusion of the proposition. □ 
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Proposition 13 .31 is the only instance where we will use average types. If unwilling 
to think about ultrafilters, the reader can just assume the existence of a way to 
extend indiscernible sequences given by Proposition 13.31 

Corollary 3.4. Let I and J be infinite mutually indiscernible sequences over A 
and let B Z) A. Let I* be as in Provosition \3.3l 

Then I'~ I* and J are mutually indiscernible over A. 

Proof. It follows from Proposition 13.31 that is indiscernible over AJ . Now, if 

J was not indiscernible over I'~' I* there would be a finite tuple a'~'b with a £ I and 
b € I* such that J is not indiscernible over Aab. Since I"" I* was indiscernible over 
AJ , and since / is infinite, we know that there are some a',&' G / such that 

tp(a'&7^J) = tj,{ab/AJ). 

But this would imply that J is not indiscernible over AI^ contradicting our hypoth- 
esis. □ 

4. ADDITIVITY OF THE DP-RANK 

In this section we will prove the (sub-)additivity of the dp-rank (Theorem 14. 8p . 
which is the main result of this paper. 

4.1. Warm up case: dp-minimal. The first technical lemma essentially deals 
with sub-additivity for dp-minimal types. It will also form the induction base for 
the general case. Although we could modify the proof of the general statement 
slightly so that it deals with rank 1 as well, we decided to include the simple base 
case explicitly, since it exemplifies the general technique that we are using. 

Lemma 4.1. Let a be any tuple such that tp(a/A) is dp-minimal, let B D A, 
and let I be a set of mutually B -indiscernible sequences. Then for any n, given 
any n + 1 mutually B -indiscernible sequences in I at least n of them are mutually 
indiscernible over Ba. 

Proof. We will do an induction on n. Since any extension of a dp-minimal type is 
dp-minimal (or algebraic), if n = 1 there is nothing to prove. 

Assume now that I := {/i, . . . , /„+i} is a set of mutually _B-indiscernible se- 
quences for B D A. By definition {/i,...,/„} are mutually indiscernible over 
BIn+i so we can, by the induction hypothesis, find n — 1 of the /j's which are 
mutually indiscernible over BI„^ia; we may assume without loss of generality that 
{/i, . . . , are mutually indiscernible over BI„+ia. If was indiscernible 
over {a} U BU ■ • • i -^n-i} the sequence {/i, . . . , /„_i, /„+i} would satisfy the 

conditions of the claim, so we may assume that this is not the case. Since non 
indiscernibility can be witnessed by a finite sequence, we will assume for the rest 
of the proof that In+i is not indiscernible over Bab for some b £ IJI^ii • • • > In-i}i 
and that {/i, . . . , In-i} are mutually indiscernible over In+iBa. 

Claim 4.1.1. It is enough to prove Lemma 14.11 under the assumption that In+i is 
not indiscernible over Ba. 

Proof. For each k with 1 < fc < 7i we will inductively define a "continuation" of 
Ik in the following way: 

Suppose we have picked /* for j < k, and define be a sequence indexed by lu 

as in Proposition 1131 for / = and B ^ BU U"^^ U [j'^jZl I* U {a} so that given 
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any subset A C B Li ^ U^=i ^ W}^ ^^^^ sequence I^I^ is indiscernible 

over A whenever /j, was indiscernible over A. 

It follows from the construction and Corollarv l3.4l that 

• {/I'^/j*, . . . , /„, /fi+i} is a set of mutually _B-indiscernible se- 
quences, 

• {/I'^/j*, . . . ,/„_i'^/*_j} is mutually indiscernible over In+iBa, and 

• In+i is not indiscernible over Bab for some b S U{-^ii ■ • ■ > -^n-i}- 

Since the sequences in {Ji'~"/j*, . . . , /„_i'^/*_]^} are mutually indiscernible over 
In+iBa, there is an automorphism fixing In+iBa and sending b to some b' £ 
U{/r, • ■ ■ , /,t_i}- Now we have 

• {/i, . . . , /„, In+i} is a set of _B6'-niutually indiscernible sequences, 

• {/i, . . . is mutually indiscernible over In+iBb'a, and 

• In+i is not indiscernible over Bb'a, 

which, replacing B with Bb', is precisely the conditions we started with plus the 
conclusion of the claim. Since any n-subset of mutually i36'a-indiscernible sequences 
of {Ii, . . . , In-i, In, In+i} would in particular be i3a-indiscernible, the claim is 
proved. □ 

Now the lemma follows almost immediately. Since {I2, 13 ■ ■ ■ ■, In, In+i} are mutu- 
ally indiscernible over IiB, there must, by induction hypothesis, be a subset of n— 1 
mutually /ii3a-indiscernible sequences. But such set cannot contain In+i since, by 
hypothesis given in Claim I4.1.1[ this sequence is not (by itself) indiscernible over 
Ba. So {I2, /s . . . , /„} are mutually indiscernible over IiBa. In exactly the same 
way we can prove that {/i, J3 . . . , /„} are mutually indiscernible over l2Ba which 
in particular implies that Ii is indiscernible over B U {/2, /a . . . , /„} U {a}. So 
{/i, I2, 13 ■ ■ ■ , In} are mutually indiscernible over Ba, as required. □ 

Corollary 4.2. (Sub-additivity of dp-rank for dp-minimal types) Lei tp(a,;/A) be 
dp-minimal for 1 < i < k. Then the dp-rank o/tp(ai . . . Ok/A) is at most k. 

Proof. By induction on k. For k ~ 1 there is nothing to do. Assume that the 
Corollary holds for all sets B and tuples of less than k dp-minimal (over B) elements. 

Now fix A and ai, . . . , Ofe dp-minimal over A. Let Ii, . . . , Ik, Ik+i be mutually 
indiscernible over A. By the lemma above, without loss of generality, /i, . . . , J^. are 
mutually indiscernible over Aa^, call it B. 

Recall that extensions of dp-minimal types have rank at most 1, so we may as- 
sume that ai, . . . , Ok-i are dp-minimal over B. Hence by the induction hypothesis, 
dp-rank of the tuple oi . . . ak-i over B is at most fc ^ 1. By definition, one of the 
sequences Ii, . . . ,Ik is indiscernible over Bai . . . ak~\ = Aai . . . Ok, which is exactly 
what we needed. 

□ 



Remark 4.3. Notice that in Claim l47l.ll we did not assume that Ik is indiscernible 
over /„ U {a}. That is, we know that Ik (for k < n) is indiscernible over Bl^k and 
over Bl^k.nO., but not necessarily Bl^kO-- This (and the analogue issue in Lemma 
14. 6p is the reason we could not work using just Fact 13. 1[ and decided to use the 
extensions described by Proposition 13.31 
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4.2. The finite case. The following proposition, from which the main result of 
this section will follow easily, is a generalization of Lemma 14.11 

Proposition 4.4. Let a be an element such that tp{a/A) has dp-rank at most k, 
and let T := {/i, . . . /„} he mutually B -indiscernible sequences with m > k. Then 
there is an m — k-suhset of I of sequences which are mutually indiscernible over 
Ba. 

To prove Proposition 14.41 we rephrase the statement in a way that will allow us 
to do an easy induction. For this we will need to following definition. 

Definition 4.5. Let I := {/i, . . . be mutually A-indiscernible sequences, and 
let a be any tuple. We will say that the pair I, a satisfies Sk,n if the following 
conditions hold: 

• \I\>k + n, 

• For any B Z) A such that X := {/i, . . . /,„} are still mutually indiscernible 
over B, given any n + k sequences in I at least n of them remain mutually 
indiscernible over Ba. 

So in particular, with this notation, a type p{x) over A has dp-rank less than or 
equal to k if and only if for any realization a of p{x) and every set I of mutually 
indiscernible sequences where |I| > fc, we have that I, a satisfies Sk.i- 

With this notation we can state a generalization of Proposition 14.41 the proof of 
which will admit a clear induction argument. We will start by proving the following 
analogue of Claim 14.1.11 

Lemma 4.6. Let a be an element, and let I be a set of mutually A-indiscernible 
sequences. Let be a subset of I and / G I fee such that J is mutually indiscernible 
over ALa and such that L is not indiscernible over AJ^a. Then we can extend A to 
a set B such that the following hold: 

• X is mutually indiscernible over B. 

• I is not indiscernible over Ba. 

• J is mutually indiscernible over Ba. 

Proof. We will assume that J is finite, which is the case we need for Theorem 
14.81 However, the general case follows exactly in the same manner, using ordinal 
enumerations of the sequences in and transfinite induction. 

We can enumerate J { Ji, . . . , J„} and, as in the proof of Claim H?l. 11 define 
a "continuation" Jj* := {a*)i^i^ for every sequence Jt £ inductively (on t) having 
that Jf^J^ is indiscernible over any 

t-i 

CCAulJXulJ j;u{a} 

over which Jt was already indiscernible. 

Because J' was mutually indiscernible over ALa it follows from Corollary 13.41 
that 

• { Jj*, . . . , J*}U{I \ J') is a set of A- mutually indiscernible sequences, 

• {J^J^, . . . , J:^J*, } is indiscernible over LAa, and 

• / is not indiscernible over Aab for some 6 G 1J{ Ji, . . . , J„}. 

Since {J^ Ji, . . . , J^J*, } is indiscernible over LAa there is an automorphism 
fixing LAa and sending b to some b' g\J{J* , . . . , J*}. Now we have 
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• X is a set of Afe'-mutually indiscernible sequences, 

• { Ji, . . . , Jri} is indiscernible over I Ah' a, and 

• / is not indiscernible over Ah' a. 

Letting B := Ah' completes the claim. □ 

Proposition 4.7. Let a he an element, n be any natural number, and let X := 
{/i, . . - Ira} be mutually A-indiscernible sequences with m > k + n such that I, a 
satisfies Sk,i- Then X, a satisfies Sk.n- 

Proof. Notice that we have already proved the result assuming fc = 1. It is enough 
to show that S'^. „ implies Sk^n+ii £md we will show this by induction on n (for a 
fixed k). 

So let I be a set of m mutually B-indiscernible sequences, a be an element such 
that I, a satisfies Sk,i for all 1 < z < n (so in particular, it satisfies Sk,n and Sk,i) 
and let I' := {/i, . . . Ik+n+i} be a subset of I; we will prove that I' contains a 
subset of size n + 1 of sequences which are mutually indiscernible over Ba. 

Let li be any sequence in I' . Since I'\{Ii} is a set of rt + fc mutually indiscernible 
sequences over Bit , there is a subset li of size n which are mutually indiscernible 
over BliQ. If li is indiscernible over Blia then we would have a set of size n + 1 of 
mutually indiscernible sequences over Ba and the proposition would be satisfied. 
So we may assume towards a contradiction that for every i the sequence li is not 
indiscernible over Blia. 

Now, for each i we apply Lemma [4.6l extending B until we get li not indiscernible 
over Ba for all i and I' are mutually indiscernible over B. This contradicts Sk^i of 
I (and Sk,n too). □ 

This completes the proof of Proposition 14.41 

Theorem 4.8. Let ai,a2 be tuples such that rk-dp(tp(ai/yl)) < ki for i G {1,2}. 
Then rk-dp(tp(ai, 02/ A)) < ki + fc2- 

Proof. Let I := {Ii, . . . , Iki+k2+i} be mutually ^-indiscernible sequences. By 
Proposition 14.41 applied to ai,I, there is a subset Ii of I of size A:2 + 1 of se- 
quences which are mutually indiscernible over Aai. By definition of dp-rank of 
tp(a2/Aai), we get that there is a sequence /' G Ii which is indiscernible over 
Aaia2. By definition of dp-rank, this completes the proof of the theorem. □ 

We get the following corollary (compare with Corollary 14. 12p . 

Corollary 4.9. Let T be any theory. 

If all the one variable types have finite dp-rank, then every type (with finitely 
many variables) in the theory has finite dp-rank. 

If all the one variable types have dp-rank < k, then every type (with finitely many 
variables) p{x) has dp-rank < \x\ ■ k. 

The following follows immediately from Theorem 14.81 and Proposition 12.81 

Corollary 4.10. Let T be any theory, and assume that all the one variable types 
have dp-rank < k. Then for every formula (p{x, y) we have ali{ip{x, y)) < 2k\x\ + 1. 

In particular, if T is dp-minimal, then for every ip{x,y) we have alt((p(x,y)) < 
2\x\ + l. 
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4.3. The infinite case. The proof of sub-additivity for the infinite case is in fact 
much easier than in the finite case. 

Theorem 4.11. LetT be a set of k mutually indiscernible sequences over A and 
a an element such that 8^,1 holds for I, a. Then Sk,k holds for I, a. In particular 
for any cardinal numbers k, A and any tuples a, b we have that 

rk-dp(a6/A) < max(K, A), 

whenever Tk-dp{a/ A) < k and Tk-dp{b / A) < A. 

Proof. Let I, a be any pair satisfying S'k.i. We can partition I = Uqek-^" ^^^^'^ ^ 
disjoint union of k many sets of k many sequences. By hypothesis we know tliat for 
any /3 the set are mutually indiscernible over AL)[J^_^pI" so by assumption we 
have that some sequence in is indiscernible over A U {j^-^pl" U {a}. Doing 
this for any (3 G k we get a set of sequences {I°'}aeK such that is indiscernible 
over A U IJq,-^^ la U {a} which by definition proves that I, a satisfies 5k.k. The rest 
of the proof follows exactly as in Theorem 14.81 □ 

Since this immediately implies that rk-dp(a&/j4) < uj whenever rk-dp(a/74) < uj 
and rk-dp(b / A) < uj, this theorem provides a very easy proof of the fact that 
strong dependence (rk-dp(p(x)) < u for all p{x) or, equivalently, no randomness 
pattern of depth co) only needs to be verified in one variable. Summarizing, we get 
the following (very) easy corollary, which was originally proved by Shelah in |12) 
(Observation 1.6). 

Corollary 4.12. A theory T is strongly dependent if and only if all the one variable 
types in T are strongly dependent. 

Also, we get a dp-rank version of Shelah's theorem that T is dependent if and 
only if the independence property cannot be witnessed by ip{x,y) with |a;| = 1. 
Recall that a theory is dependent if and only if every type is dependent, that is, 
rk-dp(p(a;)) < |r|+ for any type p(a;)Q. So the following, which follows immediately 
from Theorem l4.11[ is a new (and simpler) proof of Shelah's Theorem II. 4. 11 in [S]. 

Corollary 4.13. A theory T is dependent (which is equivalent to every type being 
dependent) if and only if all the one variable types in T are dependent. 

5. VC-DENSITY 

Recent results by Aschenbrenner, Dolich, Haskell, Macpherson and Starchenko 
[2], show that in many of the well behaved dependent theories, the FC-density can 
be calculated and, in many of the cases that they considered, it is linear. In this 
section we define FC-density (or rather, a dual notion, which we call yC*-densitj|3), 
and discuss some connections between it and dp-rank. 

For the sake of clarity, we introduce a few notations. Let p{x) be a type, and B 
a set; we denote the set of all complete types over B which are consistent with p{x) 
by S^'^^^B). If ip{x, y) is a formula, or A(a;, y) is a set of formulas, we can speak of 



We are defining a type to be dependent depending of the behavior of the "dual" formula. 
Reasons why this is the right notion can be found in Observation 2.7 in [7|. 

■^Given a family A.(x,y), the VC^-density will correspond to the yC-density of the family A 
after we invert the roles of x and y. 
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y)-types, or A(a;, j/)-types (over B) consistent with p{x); these will be denoted 
by S*^'^' and S^^\ respectively. 

We also remind the reader of some basic notation for asymptotic behavior of 
functions. Let /, N — >• M-|-. We write that / = 0{g) if for some constant r > 
for any n large enough we have f{n) < r ■ g{n). 

Recall that if / is a polynomial function, its order of magnitude is completely 
determined by its degree. That is, if f,g are polynomials, then / = 0{g) if and 
only if deg(/) < deg(5). 

Definition 5.1. Let C be a large, saturated enough, model of T, let A{x,y) be a 
finite set of formulas in the language of T, and let p{y) be a (partial) type over a 
set of parameters in C. The VC* -dimension of p{y) with respect to A is greater 
than or equal to n if there is a set A of size n such that, for any Aq C A there is 
some b \= p{y) and some 6(x, y) £ A such that for any a' G A, we have 

C h 6{a',b) ^ a' e Aq. 

Whenever this happens we will say that A shatters A with realizations of p{y). 

We will say that the VC* -dimension of p{y) with respect to A is n if the VC*- 
dimension is greater than or equal to n, but not greater than or equal to n + 1. 

Notice that if A shatters a set A with respect to p{y) G Sk{B), then every subset 
of A is (externally) definable as 

S{C,b)r\A 

where b varies among realizations of p{y) (and 6 £ A). If A is a singleton (this 
is, if there is a single formula S{x^ y) in A) this is of course equivalent to saying 
that p{y) is consistent with 2l^l different A-types over A. So, if instead of counting 
subsets we count types, we will get a notion that, although it is not exactly the 
same as l/C*-dimension when A is not a singleton, it is closely related to this 
notion (particularly asymptotically). Recall that by S^^\A) we denote the set of 
all A-types over A consistent with p{y). With this notation, we can look for the 
largest n such that there is some set A of size n such that 

|S^(^)(.1)| > 2l^l. 

We are slowly getting to the notion of yC-density that we will work with. It 
was proved (apparently independently by Saner, Shelah, and Vapnik-Chervonenkis) 
that if the yC*-dimension of A with respect to p{y) is equal to d, then, for any 
A of size greater than d, the number 7r(A,p)(^) of subsets of A externally definable 
with realizations of p, satisfies 





7rA,p(A) < 



Now, \S^'^\A)\ is bounded by |A| times iTA.piA). This implies that when the 
FC*-dimension of A with respect to p is d, then each formula in A can define (using 
parameters in p), at most 0(|A|'') externally definable sets of A. It follows that if 
we vary A among increasing subsets of an infinite set, we get polynomial growth 
of the number of A-types |5^*^^(A) over A, and a very natural question to ask is 
whether d is the best bound on the degree of the polynomial. This prompts the 
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following definition of yC*-density of a type. We will define (adapting the notions 
in [2]) the VC^-density of a type p{y) over a set C to be 

inf{r G I \SP^^\A)\ = 0(|A|'-) for all finite A C C^v^}. 

What we formally mean by this is that there exists a function / : N ^ M+ such 
that / = Oin"-), and | SP^^\A)\ < f{\A\) for all A C C finite. 

If in the definition above A is allowed to range over all finite sets (that is, C = M 
for some AI \= T saturated enough), we omit "over C", and simply say " V^C^-density 
of p". 

Using our present notation. Proposition 12.81 implies that if rk-dp(p(?/)) > fc, then 
there exists a formula ip{x^ y) and an indiscernible sequence / in the sort of y, such 
that \S^^\l')\ > ('^) for every /' C / of size n > k. This of course means that 
V^C*-density of p{y) is at least k. In order to make this connection between dp-rank 
and V^C*-density more precise, we state the following proposition. 

Recall (Proposition 12. 6p that rk-dp(p) > fc if and only if there is a randomness 
pattern la, fa of depth k for p. Below we will say that rk-dp(p) > fc is witnessed 
by formulas in A (where A is a set of formulas) if all ipa are in A. 

Proposition 5.2. Let p{y) be a type over A and A be a set of formulas which is 
closed under boolean combinations. Then the following are equivalent. 

(i) rk-dp(p) > fc, witnessed by formulas in A. 

(ii) There is an A- indiscernible sequence I and some formula (p{x, y) G A such 
that p{x) has VC* -density at least fc over /. 

(iii) There is an A-indiscernible sequence I and some formula ip{x, y) G A such 
that p{x) has VC* -density bigger than fc — 1 with respect to f{x, y) over I . 

Proof, (i) (ii) by Proposition 12. 8( as explained above (note that the formula 

one gets in Proposition 12.81 is a boolean combination of A-formulas, hence is itself 
in A), and (ii) =^ (iii) is trivial, 
(iii ) =^ (i). 

Let / : N — N be the following function: f{n) = 15^'^' (/') | for some/every I' C I 
of size n. It follows from the assumption that / is not 0{n^~^). This means that 
for every r > there is n such that f(n) > r ■ n^~^ . 

We may assume that the order type of / is R (indeed, all we need is to keep 

\Sl^^\l')\ for aU /' C / finite). We write / (a^ : r G M). 

In order to continue, we will need the following definition. Given some c \= p, 
an element r G R will be defined to be a "switch point in / for c" if there is some 
e G M such that either 

Lp(c,ar^s) ^ ~"<5(c. Or) 

for all (5 < e, or 
for all 6 < e. 

Claim 5.2.1. There is some c\= p for which there are at least fc switch points in /. 

Proof of the claim: Assume this is not the case. Let I' Q I finite, denote n =: 
Let q G Sl^^\r), c^q. Below we refer to a cut of /' (by which we mean either an 
element of /' or an interval between two adjacent elements in /') as a "switch cut 
for c in if the interval it induces in I contains a switch point of c in /. Note 
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that there are 2?! + 1 cuts in /', hence at most {^^^i) choices for possible sequences 
of switch cuts (by the assumption towards contradiction). 

Notice that q is completely determined by knowing (1) the switch cuts for c in 
(2) what are the signs of ip{c,y) of different segments between the switch cuts 
of c in /', and (3) the sings of the cuts themselves. Since there are at most ( ) 
choices for possible sequences of switch cuts, at most 2'^ possible sequences of signs 
on the segments between the switch cuts, and at most 2'^"^ possible signs for the 
switch cuts, we would get that | S^(^)(/')| = 0(|/T"^) for all contrary to the 
assumption. □ 

Let c ^ p be such that there are at least k switch points in c. We can then 
choose increasing indices Qq,. . . ,q4k-i in Q such that for all z < fc the following 
hold: 

• The closed R-interval [q^i, q4i+i] contains a switch point, and |= (p{aq^. , c) O 
~^f{o■q4^+l,c), and 

• the open M-interval [qa-^i, (74(i+i)) does not contain a switch point so that 
in particular |= ip{aq^.^2,c) ^ ip{aq^.^^,c). 

Now, let J be the sequences of pairs of / 

and let X2; y) be the formula ip{xi,y) O (p{x2,y)- 

Clearly, J is an A-indiscernible sequences and since A is closed under boolean 
combinations, ip(xi,X2,y) £ A. Finally, by construction alt^'^\ip) is at least 2k 
witnessed by J, so by Proposition 12.81 we have rk-dp(p) > k, witnessed by i/j £ A, 
as required. □ 

Remark 5.3. Notice that we needed to define switch points, of which at first there 
may seem to be as many as the alternation rank. But there is the subtle issue that 
"isolated points" only count as one switch point, even though they contribute to 
two for the alternation rank. In fact, by changing the sequence and the formula, we 
manage to ensure that all those "switch points" happen on "isolated" points (now 
pairs), each of which then contributes two alternations, hence obtaining alternation 
rank 2k. 

Proposition IS . 2l explains why in the example of non-integer VC-density presented 
in P] one has to work over sets that are not indiscernible, and why over indiscernible 
sequences FC-density becomes an integer: in this case, ^C-density simply equals 
the appropriate dp-rank. 

We now combine Propositions 12.61 12.81 and 15.21 and summarize all the main 
characterizations of finite dp-rank that we have shown in this article. 

Theorem 5.4. The following are equivalent for a type p{y) over a set A: 

(i) rk-dp(p) > k. 

(ii) There is a randomness pattern of depth k for p{x) over A. 

(iii) There is a formula (p{x, y) and an A- indiscernible sequence I in the sort 
of x such that the VC* -density of p over I is at least k. 

(iv) There is a formula i.p{x, y) and an A- indiscernible sequence I in the sort 
of X such that the VC* -density of p over I is bigger than k — 1. 
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(v) There is a formula ip{x, y) and an A- indiscernible sequence I in the sort 
of X such that for every I' Q I of size k there exists c \= p satisfying 
(p{x,c) n I ~ I' (that is, every subset of I of size k is externally (p(x,y)- 
definable by a realization of p). 

(vi) There is a formula ip{x,y) with alt^^\ip) > 2k. 

One may obtain a more precise (but also more technical) version of the theorem 
by restricting to a set of formulas A closed under boolean combinations, as in 
Proposition 15.21 

Remark 5.5. In the proof of (iii) (i) in Proposition 15.21 we only needed that 

|^p(y)^j/'j| j^Q^ whereas the assumption gives more: not 0(|/'|^) for 

some s > k — I. Along this line, we note that using clause (v) in Theorem 15.41 one 
can deduce that the following statements are also equivalent to rk-dp(p) > k. The 
statements are more technical, but the equivalences are stronger. 

(1) There is ip{x,y) and / such that |S'^^''^(/')I = for /' finite. 

(2) There is ip{x,y) and / such that \Sj^'-^\r)\ = uj{\I'\''-'^) for /' finite. 

(3) There is (p{x,y) and / such that IS^'^^^I')] is not 0{\r\''-^) for /' finite. 

Where / = fl{g) means g = 0{f), whereas / = (^{g) means that / strictly domi- 
nates g up to any multiplicative constant, that is, for every constant r > we have 
/(n) > r ■ g{n) for all n large enough. 

Note that in order to go from (3) to (1) one may need to change the formula 
and the indiscernible sequence (just like in the equivalence of (iv) and (v) in the 
theorem), and this is crucial. One may ask whether similar statements hold with 
the same formula and sequence. We have not given it much thought. 

We have recently learned that Vincent Guingona and Cameron Hill have inves- 
tigated yC*-density (and other properties) over indiscernible sequences in much 
greater detail in [3]. 

Notice that although Proposition l5 . 2l demonstrates a nice connection between dp- 
rank and l^C*-density, it is still quite unsatisfactory. One would hope to connect 
T^C*-density in general to dp-rank. For example, all known example of dp-minimal 
theories seem to have yC*-density 1 (most of what is known has been proved in 
[2]). Is this a coincidence, or an example of a deep connection? Specifically, we ask: 

Question 5.6. Does every dp-minimal theory have yC*-density 1? 

It is not so clear how to approach the general question. The proofs in [2] are 
very case-specific and difficult. Any statement which states a bound for the VC*- 
density in terms of the dp-rank, would need to involve achieving finite indiscernible 
sequences, hence require nontrivial combinatorial arguments. Some partial results 
have been obtained by the authors in a subsequent work, but not much is known 
in general. 

Thinking about the possible arguments, it came to our attention that things 
could be much more manageable if we could concentrate in single variables; by this 
we mean that both definitions -of dp-rank and yC*-density- could be made by 
looking at the behavior of the realizations of the type with respect to singletons 
(for precise statements, see the two questions that follow this discussion). This sort 
of result is not uncommon in model theory: A theory is dependent if arbitrarily 
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large sets of elements (not tuples) can not be shattered; if a dependent theory is 
unstable then the strict order property can be witnessed with elements, etc. So it 
would not be too surprising if both l^C* -density and dp-rank could be defined by 
just looking at the singletons. The following question appeared in a first version of 
this paper. 

Question 5.7. lip{x) is a (partial) type over A of dp-rank greater than n, can this 
be witnessed by indiscernible sequences of elements? This is, are there /i, . . . , /„ 
mutually A-indiscernible sequences of singletons and some c \= pix) such that Ij is 
not indiscernible over Ac for all 1 < j < nl 

This was proved to be false: there are theories which are not dp-minimal but such 
that given any element and any two mutually indiscernible sequences of singletons 
(over the empty set), at least one of them is indiscernible over the element. However, 
since the theory is not dp-minimal, you can find a type over the empty set with 
dp-rank bigger than 1, thus providing a counterexample to the question even with 
A = 0. 

The question, however, turned out to be the wrong question. The following was 
proved by Kaplan and Simon in (5]: 

Fact 5.8. [5] If p{x) is a (partial) type over A of dp -rank greater than n, there 
is an extension q of p over some B D A such that q has dp-rank greater than n, 
witnessed by indiscernible sequences of singletons. 

The second questions is concerned with the behavior of yC*-density: 

Question 5.9. Suppose that p{y) is a type such that for all 

A(a;, y) := {Si{x, y), 62{x,y), . . . , (5„(x, y)} 

where a; is a single variable, we have that the l/C*-density of p{y) with respect to 
A is greater than d. Is d the l/C*-density of p{y) with respect to any A? 

Notice that a positive answer to Question 15.91 would imply that we could define 
the VC-density of a type by considering formulas A for which a; is a singleton. If 
this were true, we would have more tools and evidence for establishing a tighter 
connection between dp-rank and X^C*-density. 
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